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Adaptive  Determination  of  Designs 
in  Attribute  Life  Testing  (*) 

by 

Mohammad  Kazim  Khan 

Virginia  Polytechnic  Institute  &  State  University 

1)  Introduction 

Consider  a  system  of  N  components  (N  is  fixed  positive  integer)  working 
independently  and  having  identical  cumulative  distribution  functions  (c.d.f.) 
of  the  time  till  failure  F(t;0).  F  is  a  known  function  and  0  is  an  unknown 
parameter,  belonging  to  a  parameter  space  0.  The  components  fail  randomly 
at  unobservable  times.  The  system  is  inspected  after  X  units  of  time  and 
the  number  of  failed  components  is  observed.  The  replacement  of  the  com¬ 
ponents  could  be  according  to  the  following  two  policies: 

(A)  Only  failed  components  are  replaced  at  each  inspection. 

(B)  All  items  in  the  system  are  replaced  at  each  inspection 
(frequent  replacement  policy,  or  block  replacement  policy). 

The  determination  of  the  appropriate  replacement  policy  depends  upon  the 
type  of  system  under  consideration.  For  example,  policy  (B)  is  preferred 
over  policy  (A)  when  it  costs  more  to  inspect  and  replace  only  failed  com¬ 
ponents  as  compared  to  changing  the  whole  system.  Moreover,  sometimes  it  is 
practically  impossible  to  change  only  failed  components  without  effecting 
the  whole  system.  For  examples  see  Barlow  and  Proschan  (1967).  In  quantal 
response  bioassay  studies  policy  B  is  followed,  where,  after  experimentation, 
the  whole  batch  of  experimental  units  (mice,  fish,  etc.)  is  replaced  by  a 

(*)  Part  of  the  Ph.D.  dissertation  written  under  the  guidance  of  Professor 
S.  Zacks  for  the  Department  of  Mathematics  and  Statistics,  Case  Western 
Reserve  University,  Cleveland  Ohio. 


new  one.  Finney  (1978)  provides  an  exhaustive  reference  list  for  such 
bioassay  designs. 

Let  J(Xj) ,J(x2) , . . . , *J(xn) »• * •  denote  the  number  of  components  failing 

n-1  n 

during  the  intervals  (0,Xj) ,  (Xj  ,Xj  ,+x2> , . . . ,  x.^  ,  x^),... 

Intuitively,  we  would  like  to  use  the  information  (J(x, ) , . . . , J(x  ),x,,...,x  ) 

1  n  1  n 

to  determine  x^+^  such  that  J(xn+j)  will  provide  as  much  information  on  0 
as  possible.  To  define  the  best  or  optimal  interinspection  time  at  the 
(n+l)st  stage,  we  shall  use  the  criterion  of  maximizing  the  conditional 
Fisher  information  about  0  given  (J(Xj) , . . . , J(xr) ,x^ , . . . ,x  ) .  More  specifi¬ 
cally,  let  F  denote  the  sigma  algebra  generated  by  (J(x, ) , . . . , J(x  ),x, , 
n  X  n  1 

...,x  )  and  let  1(0 ;x  ..IF  )  denote  the  conditional  Fisher  information  of 
n  n+1 1  n 

0  at  the  (n+1)  at  stage  given  F  .  Generally,  1(0 :x  ,,|F  )  depends  on  0  and 

n  n+l 1  n 

on  F  .  Hence,  the  optimal  value  of  x  is  a  function  of  the  unknown  para- 
n  n+l 

meter  0  and  of  the  past  history  of  the  system.  Since  0  is  unknown  one  has 
to  change  the  criterion  of  optimality  in  a  suitable  manner. 

It  is  readily  seen  (Khan  1980)  that,  if  I(F(x1;0))  and  Kojx^  represent 
the  Fisher  information  function  of  F(x^;0)  and  0  given  x^  respectively,  then 
I(F(Xl;e))  =  N/{F(x1;0)(l-F(x1;e))}  (1.1) 

and 

KejXj)  =  I(F(xi;6))(-^-  F(Xl;0))2  (1.2) 

One  can  also  easily  show  (Khan  1980)  that  under  replacement  policy  B,  the 

conditional  Fisher  Information  function,  given  F  , ,  is 

n-1 

I(e;xnlFn_i)  =  I(F(xn;0))(-^-  F(xn;9))2  (1.3) 

In  particular,  for  the  negative  exponential  failure  distribution,  (1.3) 
holds  under  both  replacement  policies. 


The  terms  'design  levels',  'dose  levels',  ' interinspection  times'  will 
be  used  interchangeably,  depending  upon  the  special  application  of  the  methods. 


2)  Adaptive  Designs 

As  discussed  in  the  previous  section,  the  tolerance  or  failure  time 
distribution  yields  for  a  design  level  x  the  probability  of  response  F(x;8). 
Let  J(x)  be  the  total  number  of  responses  at  a  design  level  x,  among  N 
identical  and  independent  units.  Given  x,  J(x)  has  a  binomial  distribu¬ 
tion,  provided  all  units  started  to  function  together.  That  is, 

J (x)  ^  B(N,  F(x,6))  . 

From  the  point  of  view  of  maximizing  the  Fisher  information  function  0, 
we  may  proceed  to  define  the  optimality  criterion  as  follows. 

Considering  1(8, x)  as  a  function  of  x,  we  would  like  to  find  the 


design  level  x^  such  that 


I(0;x)  £  I(8;Xq) 


(2.1) 


for  all  xeX  where  X  is  some  appropriate  design  space.  If  F(x,8)  is  a 


continuous  function  of  x  such  that  ——  F(x,0)  is  also  a  continuous  function 

OO 

of  x,  then  there  exists  a  unique  xQ  such  that  (2.1)  holds  provided  X  is  a 
compact  subset  of  Usually,  x^  will  depend  on  0  by  some  (known)  functional 


relation,  say,  g  i.e. 


g  :  0  +  X 
0  -f  g(0)  =  xQ(0) 


(2.2) 


Hence,  if  0  is  unknown,  cannot  be  determined.  The  following  are  some 
typical  examples  of  g  encountered  in  application 

(i)  F(x,0)  =  /*  exp(-  \  (t-0)2)  dt  ;  g(0)  =  0  .  r~ - — - 

JU  -»  Accc-rU 

This  model  is  known  as  the  Probit  model  in  bioassay  studies.  K71?  C" 

rue  tv; 

(il)  F(x,e)  =  {1  +  exp(-  (x-0))}"  ;  g(0)  =  0  .  Unr;r>n  v.r 


This  model  is  known  as  the  Logit  model  in  bioassay  literature, 
(iii)  F(x,8)  =  (e-1)  1  [e  exp{-e  0X}  -1]  ,  x  >_  0  ; 

g(0)  -  1.9366/0. 


P- _ 

r>-  X,., 


t.l  f 


/<vn  i\-,\ 
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(iv)  F(x,0)  =  1  -  exp(-x/e)  ,  x  >  0  ;  g(e)  =  1.5936  0  . 


To  overcome  this  difficulty  of  the  dependence  of  x^  on  the  unknown  para¬ 
meter  9,  we  apply  an  adaptive  techniques  for  estimating  9  by  using  a 
sequence  of  design  levels  xj ,x  , . . . .x^, . . .  and  corresponding  to  each  design 

level  we  define  an  estimate  of  0,  0  .  The  double  sequence  {x  ,6  ;n  >  1} 

n  n  n  — 

is  called  an  adaptive  design. 

Definition  (2.1) 

An  adaptive  design  {x^.0^}  is  asymptotically  optimal  if  for  each 
fixed  0  e  0, 


(i) 

e  a-vS# 

8  as  n  -v  +  oo  , 

n 

(ii) 

a.s. 
x  -* 
n 

Xq(@)  as  n  +  o° 

(iii) 

i(e  ;x  As* 

n  n 

i(e;x0(e))  . 

Note  that  if  l(0,x)  is  a  continuous  function  of  0  and  x  then  (iii)  follows 
from  (i)  and  (ii) . 

A  slightly  relaxed  (weaker)  definition  of  optimality  is  as  follows: 
Definition  (2.2) 

An  adaptive  design  {xn>0nl  is  asymptotically  e-optimal  if  for  each 
fixed  c  >  0  and  each  fixed  8  e  0, 

(i)  9  -*  0  as  n  ” 

n 

(ii)  lim  suplx  -  x„(9) I  <  e  a.s. 

n  n  O' 

(iii)  limsup 1 1(0  ;x  )  -  l(e,x_(0))|  <  e  a.s. 

n  n  u 

n 

Note  that  if  the  adaptive  design  {xn  8^}  is  independent  (functionally)  of 

e,  then  definitions  (2.1)  and  (2.2)  are  equivalent. 

Venter  and  Gastwirth  (1964)  defined  the  optimality  criterion  (in  the 

negative  exponential  case)  to  be  that  a  sequence  (x  9  }  is  asymptotically 

n  y  n 

optimal  if 

liminf  n  1  ^  EfUe^x^}  =  I(0;xQ(0))  ,  (2.3) 

for  each  0  e  0 


i 


» 1 

Note  that  if  an  adaptive  design  is  optimal  in  the  sense  of  definition  (2.1) 
then  by  the  Lebesque  dominated  convergence  theorem  and  the  regularity  pro¬ 
perty  of  the  Cdsaro  means  (Powell  and  Shah  (1972),  Knopp  (1956))  it  is 
asymptotically  optimal  in  Venter's  sense.  However  the  converse  may  not 
hold.  Therefore,  definition  (2.1)  is  a  stronger  optimality  criterion. 

One  of  the  shortcomings  of  definition  (2.1)  is  that  it  does  not  take 
into  account  the  rate  of  convergence  of  the  adaptive  design.  This  factor 
could  be  very  important  for  experiments  of  moderate  sample  size.  There¬ 
fore,  it  is  preferable  to  find  some  bound  to  the  asymptotic  variance  of 
the  adaptive  design. 

3)  Discrete  Adaptive  Designs 

In  this  section  we  shall  assume,  unless  otherwise  stated,  that 

(i)  X,0  are  compact  subsets  of  R  . 

(ii)  F(x,0)  is  a  differentiable  function  of  0  for  each  fixed  x  so  that 
the  Fisher  information  function  exists. 

(iii)  F(x,0)  has  a  unique  continuous  inverse  for  each  fixed  x. 

£ 

(iv)  77  F(x,0)  is  a  continuous  function  of  x  and  0. 

OO 

(v)  g(0)  is  a  continuous  function  of  0,  where  g  is  as  defined  in  (2.4). 

(vi)  1(0, x)  satisfies  the  Lipschitz  condition. 

Condition  (i)  will  not  have  any  effect  in  applications  of  the  results. 

Conditions  (ii)  -  (vi)  will  be  satisfied  in  almost  all  the  models  encountered 
in  bioassay  and  reliability  studies.  For  example  for  the  Probit  and  Logit 
models  the  above  conditions  will  be  satisfied  when  0  is  the  shift  parameter. 

Since  0  is  a  compact  set,  we  can,  without  loss  of  generality,  assume 

that 

Q  =  [a,b]  ;  -oo  <  a  <  b  <  +®  .  (3.1) 

Furthermore,  since  g  is  a  continuous  function,  g(0)  is  also  a  compact 


set.  Therefore  it  is  reasonable  to  define  the  design  space 


X  =  g(0)  =  ta'.b"] 

(3.2) 

where 

a'  =  inf  g(0) 

(3.3) 

6e0 

and 

b-  -  gug  g(8) 

(3.4) 

For  any  given  e  >  0,  let  K  be  an  integer  such  that 

K  >  (b"  -  a ')/c 

and  define 

dt  =  a'  +  K_1(b'  -  a')  i  ,  i=0,...,K 


(3.5) 


(3.6) 


All  the  experiments  are  performed  at  some  of  these  design  levels.  Note  that 

(3.7) 


di+i  ■  di  < e  ;  1  * 0,1 . K_1 

Define  the  set  of  discrete  designs  to  be 

X'  —  {d.  j  1  =  0,1,2 . K} 


(3.8) 


Unless  otherwise  stated  we  shall  assume  that  g(0)  $  X'.  The  first  design 

level  X  is  a  random  variable  taking  values  in  X'.  The  maximum  likelihood 
i,K 

estimate  of  F(di,0)  given  XjL  R  *  d±  and  N  ls 

N_1  J1(di)  =  (di>  . 


We  define  the  estimate  of  0  as 

0, 


1,K 


where 


^a  = 


'di  ’  J1 

• 

fa,  if 

X  < 

a 

if 

a  < 

x  <  b 

[b,  if 

x  > 

b 

(3.9) 


Adaptively  at  the  n^  stage  (n  >_  2)  define  the  design  level  X^j,  e  X  such 
that 


X  =  d 
n  jK  i 


(3.10) 


if  g(°n'l,K')  C  ^di  ’  di+l) 
This  implies  that  for  all  n  2 


-  6  - 


) |  <  e  almost  surely 


(3.11) 


n,K 


g(  9, 


n-1  ,K 


Let  Jn(d^)  denote  the  total  number  of  responses  among  N  units  at  the  nth 

stage  given  X  =  d  .  Also  let  F  be  the  sigma  algebra  generated  by 
n  >  k  l  n 

(X  v . X  ,J  ,...,J  ),  then  due  to  the  block  replacement  policy,  (and 

i  y lx  HjK  1  n- 1 

the  memory  less  property  of  the  exponential  distribution  in  policy  A) . 

Jn(di>|Fn^  B(N,  F(di,6))  .  (3.12) 

(For  more  details  see  Khan  (1980)  and  Zacks  (1973).) 

At  the  nth  stage  we  define  an  estimate  of  0  as 


n,K 


K 

.-In  n 


.-1, 


(3.13) 


Where  M  is  the  total  number  of  times  in  n  stages  the  design  level  d  was 
i>n  i 


repeated  and  J 


denotes  the  average  number  of  responses  during  these  M. 
i,n  1,n 


repititions  of  d^. 

Hence,  for  each  fixed  e  >  0,  we  define  the  discrete  adaptive  design 
{X  ,  6  }  for  {g(0),0}.  Note  that  K  depends  on  e,  for  simplicity  of 

n jN  n , r 

notation,  however,  we  will  write  K  instead  of  K(e). 

The  following  lemma  and  a  theorem  of  Anscombe  are  needed  for  further 
developments . 


Lemma  (3.1) 

If  {Y  }  is  any  sequence  of  random  variables  such  that 
n 

a  #  s 

Y  -+■  ’  0  as  n  ->  +» 
n 

and  {N^}  is  any  sequence  of  non-negative  integer  valued  random  variables 
such  that 


then. 

Proof : 


,,  a .  s .  , 

N  ->  4®  as  r  +  +» 

r 

„  a .  s . 

Y  -*■  0  as  r  +  4® 

N 

r 

See  M.K.  Khan  (1980)  or  R.A.  Khan  (1975). 
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Theorem  (3.1)  (F.R.  Anscombe) 

Suppose  that  Xj  X2 , . . . ,Xn> . . .  are  independent  and  identically  distri¬ 
buted  random  variables  with  mean  zero  and  variance  one.  Let 

S  *  X,  +  X„  +  . . .  +  X  ;  n  >  1  . 

n  1  2  n  - 

Furthermore,  let  v(t)  denote  a  positive  integer-valued  random  variable 
for  any  t  >  0  such  that 


L<li  £ 


c  as  t  -+  +co 


where  c  >  0  is  a  constant.  Then  for  any  x  c  ]R  , 


lim  Pj  V-(t)-  <  x 

t-H-co  I  l/\)  (t) 


=  $(x)  =  —  - —  /  exp(-u2/2)  du 

/2tt  -°° 


Proof . 


See  Anscombe  (1952).  For  a  simpler  proof  of  the  theorem  see  Renyi  (1957), 
Lemma  (3.2) 

For  the  discrete  adaptive  design,  let  d^  be  the  maximal  design  level 

smaller  than  g(0)  and  M.  is  the  associated  number  of  repetitions  of  d^ 

i 

then 

M  aTs '  +oo  as  n  -*■  +°"  [PQ] 
i  ,n  0 

Proof . 

By  negation,  if  the  lemma  is  false,  there  exists  a  set  A  c  fl  such  that 

P (A)  >  0  (3.14) 

and  for  each  w  e  A,  as  n  +  +» 

M.  (w)  ■*  M.  (w)  <  +” 
i,n  i 

(Note  that  lim  M.  (w)  always  exists,  being  a  non-decreasing  sequence  of 
n->+“  i,n 

integers.) 


Z  H  (u ))  =  n,  for  all  n  and  for  each  u>  t  ft  , 

3=0  j,n 


8  - 


Since, 


as  n  +  +»> 


q  i  l. 


,  there  exist  some  design  levels,  say,  ,  d4  , 

Jq 


V  J2 


such  that  as  n  +  +»  , 


M  (w)  -*•  +oo  ,  %  =  l,2,...,q  , 

and  for  each  j  j*  j  ,  S.  =  l,2,...,q  ,  there  exist  constants  M.(w)  such 


that  as  n  +  -U 


M.  (w)  -►  M .  (ii>)  <  . 

J.n  J 


By  the  strong  law  of  large  numbers 


I J  -  F  (d  . ,  6 )  I  a4-s  0  as  n .  -*•  +°° 
1  n.  3  1  j 

J 

Therefore,  for  almost  all  u  e  A,  the  subsequence 


JM  («)  -  F(d.,0)|  -v  0 

S  n  J 


vn 

as  n  -»■  +to  ,  i  =  1 ,2, . . .  ,q 

By  the  continuity  of  F  *  and  the  fact  that  0  e  [a,b] , 
[F"1(di  ’  JM  )]a  =  YM  (u)  9 

*  V"  V" 


as  n  -+  +«°  ,  for  each  Jl  =  l,2,...,q 


Now 


K 


,  ,  K  _i 

0  -6  <  .Z_  n  M.  Y  -  0 

1  n,K  1  -  ]=0  j,n!  M  1 

J 


1  jfi0  n_1  Mj,n(b-a)  +  Jl  n_1  Mjo  n  lYM.  "  9 1 

Jp,n 

(j  +  ;  5,  =  l,2,...,q). 

Therefore,  for  almost  all  w  e  A,  we  have 

l0n,K(o))  "  0i  i°(1)  +  °(1)  Jl  n_1  \,n 

=  o(l)  . 


(3. 


By  the  definition  of  X  „  we  have 

n,K 


g(0n-l,K)  -  (b-l)/K  £.  xn>K  —  g<0n-l,K> 


This  implies  that  for  almost  all  u  e  A 


limsup  I X  (oj)  -  g(0)  I  <  (b-a)/K  . 

n  .N  — 

n 


-  9 


15) 


(3.16) 


It  follows  that 


(3.17) 


X  „(u.)  =  d .  infinitely  often, 
n,  N  i 

for  almost  all  ui  r  A. 

Hence,  for  almost  all  u)  c  A, 

M.  (o)  ->  -Ko  as  n  ■>  +“> 

i,n 

This  contradicts  the  definition  (3.14)  of  the  set  A.  Hence, 

P(A)  =  0 


i.e.  , 

M .  a4s"  ^  as  n  +«>  _  (Q.E.D.) 

i,n 

Lemma  (3.3) 

For  the  discrete  adaptive  design 

p  (M.  -*•+«>)=  0  , 

6  j  ,n 

for  all  j  ^  i,  where  d^  is  the  maximal  design  level  less  than  g(0) . 
Furthermore , 

-1  . ,  a .  s .  , 
t,n 

Proof . 

[f  the  Lemma  is  wrong,  there  exists  a  j  ^  i  and  a  set  B  c  fi  such 

that 

B  =  {w:  M.  (w)  ■>  +«>} 

J  > n 

and 

P(B)  >  0  .  (3.18) 

Let  u  c  B,  since  by  the  negation  hypothesis 

M.  (u>)  -»  +°°  , 

1  »n 


X  „(«)  =  d.  infinitely  often. 
n,K  j 

By  lemma  (3.2), 

M.  (w)  ->  ,  as  n  -*•  +“  , 

l  ,n 

for  almost  all  u>  c  A  . 


(3.19) 
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Theorem  (3.2) 

The  discrete  adaptive  design  fx  „  ,  0.  „}  is  as_ymptotica_Ux. 
- — - — ■  ”  n  y  ix 

e  -  optimal  for  {g(0),0}. 

Proof. 

Without  loss  of  generality  let  g(0)  e  (d^  ,  di+l>- 

By  lemma  (3.3)  we  have, 

n  *  M.  a4.s>  j  as  n  -► 
i,n 

By  the  strong  law  of  large  numbers  and  lemma  (3.1),  we  have 

J. 


„  a4_Sj  F(d  ,8)  as  n  -v  +» 
M ,  i 

i,n 


By  the  continuity  of  [F  1(di,y)]^  with  respect  to  y  and  the  fact  that 


0  e  [a,b] ,  we  deduce  that 


M 


d  c 

->  ‘  8  as  n  +°° 


i,n 


(3.23) 


Hence, 


|8„-0!  '  I  jio  MJ,„  V  - 


K 


-1 


<  n  M.  Ym 

-  i=0  i,n'  M. 

J  J  ,n 


3>n 

-  ei 


<  (b-a)  |  n-‘  H  +  |Ym  -8| 

k 

a.  s . 

=  o ( 1 )  by  (3.23)  and  lemma  (3.3) 
which  proves  (i)  of  definition  (2.2)  . 

Since, 

l*n,K  - 8(8)1  i  lxn,K  -  ‘<Vi,i)I  +  htVi.K*  -  8(e)l 

<  (b-a) /K  +  o ( 1 )  , 

by  taking  limsup,  we  get  (ii)  of  definition  (2.2)  . 
n 

In  fact,  we  have  proved  that  with  arbitrary  large  probability 

X  v  -  d 

n,K  i 


(3.24) 


12 


as — — 


for  all,  except  finitely  many,  values  of  n. 

Furthermore,  I(6,x)  is  a  continuous  function  of  (A,x),  satisfying  the 
Lipschitz  condition.  Therefore,  there  exists  a  constant  A  <  +“  such 
that 

limsup|l(6n  K,Xn  ~  I  t.  A  K  ^  •  (3.25) 

n 

By  taking  K  large  enough  we  get  (iii)  of  definition  (2.2).  (Q.E.D.) 

Theorem  (3.3) 

For  the  discrete  adaptive  designs  {X^  R,  0n>K^ 

/n(6  „  -  6)  S  N(0,D)  as  n  -*•  4® 

n  f  K. 

for  each  0  e  (a,b)  such  that  g(0)  c  (di’di+l^ 
where  D  =  F(d1,6) (l-F^.O))  — ^  F  (d^e) I e=F(d  ,0) 


Proof. 

By  the  Central  limit  theorem 

/n.  (J  -  F(d  ,0))  2  N(0,D  ) 
l  i  i 

as  n^  -►+<*>  ,  where, 

Di  =  Ni1  F(di’e)(1  "  F(di’e>>  • 

By  lemma  (3.3)  and  Anscombe's  theorem  (3.1), 

M.  (JM  -  F(d.,0))  2  N(0,D  ) 

i»n  Mi>n  1  1 

as  n  -+  -H=° 


which  implies, 

/n  (JM  -  F(d  ,0))  2  N(0,D1) 
i,n 

as  n  ■>  +«> 

Therefore  by  the  well  known  property  of  continuous  function  of  a  sequence 
satisfying  the  central  limit  theorem  (see  Billingsley  (1979)  pp.  320,  problem 
27.10)  we  have 


-*“h 
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/n  (IF~  <V  *  °> 

i,n 

=  ^  O'  -  0)  2  N(0,D) 


for  each  0  r.  (a,b),  as  n  ►  -Ki. 


where 


Finally, 


3  „-l 


D  ~  Di  F  W.,z)|  z  =  F(d1,e)  y  . 


(3.26) 


/n  (0nK-9)  -  /n  (  ,£o  n'1  M  -  9) 

_ j  l'n  K 


■”  "*•»  /n  \  „  ~6>  +  /n  jJo"'  "j,,  -0 

*  *  ;  _•  1  .n 


By  lemma  (3.3) 


-1/2  M  a.s.  _ 

n  M.  ->•  o 

J.n 


for  each  j  ^  i  . 


Therefore, 


/n  (0njK-0)  =  n"1  M.n  /n(Yw  -  0)  +  o  (1) 

i,n  p 


which  implies  by  (3,26) 


/n  (°n  K-9^  ^  N(°>D> 


3S  n  -*  4*00  . 


(Q.E.D.) 


Remarks . 


such  that 


(l)  If  di,n  '  f(Mi,n,n)  where  f  is  3  measurable  function  of  M  ,  n 

i,n 


i=0  di,n  a“S'l  Vn  , 

0  1  d1>n  i  1  a-s.  Vi  and  V  n 


and  define  an  estimate  of  0  by 

K 


0  „  =  d  Y 

n,K  i=0  i,n  m, 

i,n 
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Then  all  of  the  above  mentioned  results  for  the  discrete  adaptive 

design  will  hold  when  0  is  replaced  by  0  v  under  suitable  con- 

n  1 n 

ditions  on  f. 

One  such  function  is 


d.  n(r) 
i  ,n 


M,  KM., 
i,n.  „  i,n.-l  , 

(  r  )  ;  r  >  1 

Such  a  weighting  smoothes  out  the  effect  of  the  first  guess,  X 
very  fast. 

(ii)  The  discrete  adaptive  design  may  be  used  to  prove  the  asymptotic 
optimality  of  certain  continuous  adaptive  designs. 

(iii)  Asymptotic  confidence  band  for  0  are 


l.K’ 


and 


1/2  -1/2 

L(0)  =  °n,K  '  \,2  D  » 


U(9)  "  °n.K  +  Za/2  ^  "'1/2 


where  D  is  given  in  theorem  (3.3.2)  and  Z  represents  the  (l-a/2) 

a  /l 

inverse  of  the  standard  normal  distribution  function. 


So  far  we  have  assumed  that  g(0)  4  d^  for  i  =  0,1,..., K.  The  following 

theorem  considers  the  case  when  g(0)  =  d  .  for  some  i. 

6  i+1 

Theorem  (3. A) 

For  the  discrete  adaptive  design  if  there  exists  an  i  such  that  for 
some  fixed  K 


g(9)  =  d1+1  ,  then 

(i)  9  „  a^S"  9  as  n  -*  +®  , 

n,K. 

(ii)  limsupiXn  R  -  g(6) |  <  (b-a)/K  , 
n  * 

(iii)  limsup|l(8n  k  ’  Xn  ~  I(0,g(9)|  <  AK  '  (b-a)  where  A  <  +°° 
n  ’  * 


is  a  constant 


Proof_._ 

By  similar  arguments  .as  lemma(3.2)  and  lemma  (3.3)  one  can  easily 
show  that 


for  all  j  +  i,  i  +  1. 


P(M ,  ->  +°°)  =  0 

j  .n 


Which  Implies  that 


n_1  (M.  +  M  )  Hs'  l 

t,n  1+1, n 


(3.27) 


as  n  *  +«> 

Bv  similar  arguments  as  theorem  (3.2)  part  (1)  follows  that 


0  a4s  f)  as  n  +ot> 

n ,  K. 


Since, 


*<Vl.K>  *  (b-a)/K 


X„  ,  <  g<»  .  _), 

n,K  n- 1 9  K 


by  taking  limsup  ,  we  get  (ii). 
n 

Since  I(  >,x)  satisfies  the  Lipschutz  condition  we  get  (iii) 
Remark. 

Since  g(«)  =  d  ,  there  may  exist  a  0  <  p  <  1  such  that 


(Q.E.D. ) 


l>(0n,K  *  °  i-°’)  =  P 

Thus,  K  =  ^ i  fnffnfte*y  often  with  probability  p 

and  Xr  ^  =  d infinitely  often  with  probability  1-p. 

Therefore  the  result  on  asymptotic  normality  may  not  hold. 

Remark. 

We  can  construct  test  of  hypothesis  concerning  0.  Let  H:0  *  0^  vs. 
appropriate  alternative,  the  quantity 

"iVn'V  -  '’<VV>2IF<V’o><1  -  F<VV>,'‘ 

i.n 


measures  the  discrepancy  between  the  observed  and  the  expected  frequencies. 
Let  v  be  the  total  number  of  design  levels  yielding  (after  pooling  if 


necessary)  the  quantity 


R,  „  =  N  M  F(d  ,0  )(1  -  F(d  ,0  )) 
i,n  i  i,n  i  0  10 


greater  than  9,  then  under  H,  and  given 


M  ;  i  =  0,1,2 . K, 

t  ,n 


the  statistics 


*2M  ■  jo  «,  «1>n)2  <•>„  -  F<d1,0o>}2 

i  ,n 

has  approximately  a  conditional  chi-square  distribution  with  v  degrees  of 
freedom. 

(4)  Comparison  of  the  dad  with  Continuous  Designs 


There  are  many  ways  to  define  continuous  adaptive  designs  {x  ,0  }  such 

n  n 


that 


3  •  S  • 

0  •>  *  0  as  n  -> 

n 


3  •  S  • 

x  4  *  g(e)  as  n  -+  +°* 
n 

and  l(0n,xn)  a4s‘  l(e,g(e))  . 

For  example,  consider  the  following  stochastic  approximation  method.  For 

— x/0 

the  negative  exponential  model  in  which  F(x;0)  =  1-e  '  . 

Let  x^  be  any  random  variable  taking  values  in  (0,+«>).  After  defining 

x,,x„,...x  and  observing  the  responses  J(x.) ,J(x_) , . . ,J(x  )  we  define  the 
i  z  n  l  /  n 

(n+l)th  design  level  xn+j  as 

xn+1  =  xn  +  an(J<xn)/N  -  1  +  exp(-c) }  (4.1) 

where  J(x  )  is  the  total  number  of  responses  (failures)  out  of  N  items 
n 

(components)  and  c  =  1.5936. 

And  define  the  estimate  of  0  as 


0 


-1 
c  x 


n+1  “n+1 

Usually,  the  sequence  a  is  taken  to  be  d/n,  where  d  is  a  constant. 


(4.2) 


It  is  readily  seen  that  (4.1)  is  a  special  case  of  the  Robbins-Monro 
(1951)  stochastic  approximation  method.  Therefore,  by  the  well  known  results 
(Wetherill  (1963),  (1975))  on  the  properties  of  the  Robbins~Monro  procedure 


17  - 


(4.3) 


which  implies  that 


a.s.  „  . 

x  ■>  c0  as  n  -*•  +“ 
n 


3.S.  .  . 

0  *>  0  as  n  •+  +<* 

n 


2  A  “1 

Since,  1(9, x)  =  Nx  0  (exp(x/9)  -1)  is  a  continuous  function  of  (9.x)  by 


(4.2)  and  (4.3)  we  have 


Also 


where 


1(0  ,x  )  ai.s*  1(0, c8)  as  n  -* 
n  n 


V  2 

</n  (0  -0)  *  N(0  ,0  ,)  as  n  -►  -Ho 

n  d 


a2  =  d2(eC  -  l)/{c2N(2dB-l)}  ;  dB  >  1/2 
-1 


(4.4) 


B  =  0  exp(-c) 


One  can  easily  check  that  o,  is  minimized  if 

d 


d  =  B 


-1 


and 


rain  cr2  =  (eC-l)N  ^(e/c)2 
d  d 


(4.5) 


Another  solution  to  this  problem  was  given  by  Venter  and  Gastwirth  (1964) 

by  proposing  maximum  likelihood  (ML)  and  stochastic  approximation  (SA)  methods. 

Both  ML  and  SA  procedures  of  Venter  are  strongly  consistent  and  asymptotically 

normal,  i.e.,  if  9  represents  Venter's  ML  or  SA  estimate  of  0  at  the  nth 
n 


stage,  then 


where 


/n  (0  -0)  ->  N(0,V) 
n 


V  =  (exp(c)-l) (0/c)‘ 


(4.6) 


For  the  discrete  adaptive  design  9  „  ,  we  have  from  theorem  (3.2)  that 

n,k 


where 


Sn  (0  -  0)  ^  N(0,D) 

n 


D  -  exp(d^/8)  N^1  0^  d2 


(4.7) 
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T” 


where  d^  %  co  and  is  the  number  of  components  used  for  design 
level  d^. 

One  can  easily  show  that  for  the  Venter's  procedures,  if  the  system  is 
composed  of  N  components  (instead  of  one  component) 

Var(/n  0n>  -+  V/N  .  (4.8) 

Hence,  the  asymptotic  variance  of  these  three  procedures  have  the  following 
relationship 

D  ^  V  =  min  £  o^  .  (4.9) 

2 

It  can  also  be  shown  that  min  is  in  fact  the  least  possible  variance 
(Cramer-Rao  lower  bound)  of  designs  which  are  strongly  consistent.  There¬ 
fore,  in  practical  situations,  especially  for  small  sample  sizes,  the  minimum 
asymptotic  variance  criterion  may  not  help  to  choose  the  best  adaptive  design 
out  of  the  two  adaptive  designs  of  Venter  and  the  discrete  adaptive  design. 

In  terras  of  computational  ease,  note  that  for  the  discrete  adaptive 
design 

Jn+1(x)  =  n  (n+1)  JJn(x)  +  (n+1)  1  Jr+1(x) 


and 

M.  =  M.  +  HX  . .  =  d  }  . 

i,n+l  i,n  n+1  i 

Bv  using  these  two  equations,  we  see  that  the  discrete  adaptive  design  and 
the  Venter's  SA  procedure  have  almost  the  same  level  of  difficulty  in  computa¬ 
tion.  However,  Venter's  ML  procedure  is  considerably  more  difficult  to  apply 
in  real  situations. 

Furthermore,  for  the  application  of  the  discrete  adaptive  designs  we 
need  only  finitely  many  levels  which  could  be  pre-defined  and  made  ready  before 
the  actual  experimentation,  and  hence,  will  be  more  suitable  in  those  situations 
for  which  there  is  a  natural  discretization  of  the  design  space  (e.g.,  experi¬ 
ments  could  be  performed  at  certain  hours  only,  or  at  certain  fixed  levels 
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(which  cannot  be  split  into  smaller  fractions)  of  the  process) . 

One  should  also  note  that  none  of  these  adaptive  procedures  yield  un¬ 
biased  estimate  of  0  for  any  fixed  sample  size. 

5)  Designs  Having  Minimal  Cost 

So  far  we  have  been  dealing  with  maximization  of  the  Fisher  information 
function  of  0.  Now  we  shall  discuss  the  construction  of  adaptive  designs 
yielding  minimum  value  of  a  specified  cost  function.  One  cost  function  is 
proposed  as  follows.  Let  us  denote  by  T\  the  (unobservable)  failure  time 
of  component  i  =  1,2,..., N.  Let  [0,x)  be  an  interinspection  interval.  Then, 
(x-T^)+  denotes  the  length  of  time  the  ith  component  has  been  in  state  of 
failure,  where 


(x) 


+ 


if  x  <  0 


(/  if  x>0  . 

Accordingly,  let  h((x-T^)+)  denote  the  failure  cost  of  the  ith  component. 
h(»)  should  be  non-negative  perhaps  monotonically  increasing  function  such 
that  h(0)  =  0.  Let  c^  be  the  cost  of  replacing  a  failed  component  and  c ^ 
be  the  cost  of  inspecting  a  component,  then  under  the  assumption  of  additive 
costs,  the  total  cost  associated  with  design  level  x  is 


B(x)  =  ±Z1  h((x-T.)+)  +  Cj  J(x)  +  Nc2 

where  J(x)  denotes  the  total  number  of  failures  during  the  interval  (0,x). 
Venter  and  Gastwirth  (1964),  Zacks  and  Fenske  (1973)  and  Anbar  (1976)  con¬ 
sidered  this  cost  function  for  (1.1.1),  where  h(t)  is  a  linear  function  of 
t.  Let  C(x)  denote  the  average  cost  per  time  unit  associated  with  the  design 
level  x,  i.e. , 


C(x)  =  B(x)/x 

The  optimal  design  level,  x*,  is  defined  as  the  value  of  x  for  which 
the  expected  average  cost  per  time  unit  is  minimized,  i.e., 


X  I  X  , 


K{C(x*)|  <K{C(x)} 
provided  such  an  x*  exists. 

Furthermore, 

-1  N  + 

E{C(x)}  =  x  {  i|1  E[h((x-Ti)  )]  +  ClNF(x,0)  +  c^}  ,  (5.1) 

* 

Since  (5.1)  depends  on  0,  the  design  level  x  yielding  minimum  value  of 
(5.1)  depends  on  0.  Therefore,  we  consider  adaptive  designs  which  converge 
to  x*  (  0)  . 


Approximate  h(*)by  the  first  two  terms  of  its  Taylor  series  expansion. 


i.e. , 


since 


h((x-T.)+)  %  h(0)  +  (x-T.)+  h'(0) 


(5.2) 


h(0)  =  0 

h((x-Ti)+  ^  h'(0)  (x-T1)+  . 

Let  cQ  *  h  (0),  which  represents  the  cost  of  a  unit  of  idle  time  of  the 

failed  component  i.  For  (5.3)  one  can  easily  show  that  (see  Anbar  (1976)  in 

the  negative  exponential  model, 

E{C(x)  }  =  x-1  N{c0[x-6F(x,9)]  +  c^x.e)  +  c,,}  (5.4) 

* 

and  the  design  level  x  minimizing  (5.4)  is  the  solution  of 

—  1  /  V  —  1 

(1+0  )  exp(-x/0)  =  1  -  c2(cQ0  -  Cj)  (5.5) 

provided 

0  <  c2(cQ  -  Cj)-1  <  1  ,  (5.6) 

otherwise  we  can  reduce  the  cost  by  not  inspecting  the  system. 

By  (5.5)  we  get 

x*  =  0  _1(1  -  c2(cQ  -  Cl)-1)  (5.7) 

where 


(x)  =  (x+1)  exp(-x)  ;  x  >_  0 

*  it 

This  is,  x  is  a  continuous  function  of  0  such  that  for  0  e  [a,b] ,  x  is 
bounded  away  from  zero,  where 
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(5.8) 


a>c01(cl+c2)  • 

k 

Note  that  while  F(x  ,0)  depends  on  9,  F(c9,6)  =  l-exp(-c)  is  independent 
of  9.  Due  to  this  fact  the  usual  Robbins-Monro  type  stochastic  approxima¬ 
tion  methods  (used  for  estimating  y  such  that  F(y,0)  is  a  known  constant) 
cannot  be  applied. 

To  overcome  this  problem  Venter  and  Gastwrith  (1964)  and  Anbar  (1976) 
proposed  equivalent  adaptive  designs  for  the  negative  exponential  model.  We 
will  not  discuss  these  designs  here.  In  the  following  we  shall  show  that  the 

discrete  adaptive  design  can  easily  be  modified  in  such  situations. 

* 

Let  x  (0)  be  any  (known)  continuous  function  of  the  parameter  0  such 


that  there  exist  two  constants  a',  b'  so  that,  for  each  0  e  [a,b]  =  0 


0  <  a'  <  x  (0)  <  b'  <  +°° 


(5.9) 


and 


a'  =  inf  x  (0) 

0eO 

b'  =  sup  x  (9) 

0C0 

* 

(Note  that  x  defined  by  (5.7)  satisfies  these  conditions). 

•k 

Let  X  =  [a%b']  and  K  be  an  integer. 

Define 


X'  =  d. 


d.  =  a'  +  K_1(b'-a')  i=0,l,...,K 


(5.10) 


Let  x.  be  a  random  variable  taking  values  in  X'.  After  defining 

i  ,K. 


2,K’ ’ ' • ’  n-l,K 


k  k  k 

,x_  ,  „  and  0,  v,...,0_  ,  „  define. 


1 ,K’ ’ ' ‘ ’  n-l,K 

Xn,K  =  ai  if 

X  (0n-l,K^  c  ^di  ’  di+P 


(5.11) 


and 


K 


-1. 


9n  K  =  i-n  n  n  [F*" 1  (d  j  *  Jv*  •  - 

n,K  i-0  i,n  l  M.  a 

i>n 


)]”  .  (5.12) 

a 
l 

For  the  sake  of  completeness  we  state,  without  proof,  the  following  theorems. 
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The  proofs  follow  by  simple  reworking  of  the  arguments  in  the  theorems 

*  * 

(3.2)  and  (3.3)  after  replacing  g(0)  by  x  (0)  end  g(fl  )  by  x  (6  ). 

n  ,K  n,K. 

T I toor eiw  (5.1) 

For  the  modified  discrete  adaptive  design  defined  by  (3.5.11)  and 


(3.5.12), 

if 

d.  +  x 

1 

(9)  > 

j  =  0,1,2,. ...K, 

then 

(i) 

* 

0 

n 

J 

a.s. 

,K 

as 

n  -*-+«>  , 

(ii) 

i  * 

limsup  X 

1  n. 

K  -  **(0)1  aiS*  (b'-a 

')/K 

n 

(iii) 

/n 

* 

(0n  k~ 
n«K. 

0)S 

N(0,D*)  as  n  -*• 

where 

D*  =  N~ 1  F(d.,0)(l  -  F(d1,6))  F_1(di,e)/e  =  F(d.,6)}2 

and  d^  is  the  maximal  design  level  belonging  to  X.'  less  that  x  (0). 

Theorem  (5.2) 

For  the  modified  d.a.d.  defined  by  (5.11)  and  (5.12)  if  a^+^  =  x  (6) 

for  some  i,  then 

(i)  0  „  a4-s‘  0  as  n  -*■  +°°  , 

n,K. 

(Li)  lim  sup|x  -  x  (0)  a£s '  (b'-a')/K 

IlfK 

Remarks . 

(i)  All  the  remarks  following  theorems  (3.2)  and  (3.3)  trivially  carry 
over  to  the  modified  d.a.d.  procedure  (5.11),  (5.12). 
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